A study of validity and usability evidence for non-technical skills assessment tools in simulated adult resuscitation scenarios.

BACKGROUND: Non-technical skills (NTS) assessment tools are widely used to provide formative and summative assessment for healthcare professionals and there are now many of them. This study has examined three different tools designed for similar settings and gathered evidence to test their validity and usability. METHODS: Three NTS assessment tools designed for use in the UK were used by three experienced faculty to review standardized videos of simulated cardiac arrest scenarios: ANTS (Anesthetists' Non-Technical Skills), Oxford NOTECHS (Oxford NOn-TECHnical Skills) and OSCAR (Observational Skill based Clinical Assessment tool for Resuscitation). Internal consistency, interrater reliability and quantitative and qualitative analysis of usability were analyzed for each tool. RESULTS: Internal consistency and interrater reliability (IRR) varied considerably for the three tools across NTS categories and elements. Intraclass correlation scores of three expert raters ranged from poor (task management in ANTS [0.26] and situation awareness (SA) in Oxford NOTECHS [0.34]) to very good (problem solving in Oxford NOTECHS [0.81] and cooperation [0.84] and SA [0.87] in OSCAR). Furthermore, different statistical tests of IRR produced different results for each tool. Quantitative and qualitative examination of usability also revealed challenges in using each tool. CONCLUSIONS: The lack of standardization of NTS assessment tools and training in their use is unhelpful for healthcare educators and students. Educators require ongoing support in the use of NTS assessment tools for the evaluation of individual healthcare professionals or healthcare teams. Summative or high-stakes examinations using NTS assessment tools should be undertaken with at least two assessors to provide consensus scoring. In light of the renewed focus on simulation as an educational tool to support and enhance training recovery in the aftermath of COVID-19, it is even more important that assessment of these vital skills is standardized, simplified and supported with adequate training.

A Literature Review of Simulation-Based Nursing Education in Korea.

This study reviewed the papers that studied the effect of simulation nursing education in the nursing field and examined the trend of simulation nursing education for nursing college students in Korea. BACKGROUND: Simulation-based education started receiving attention as a pedagogical method in order to provide medical service of high quality in an ethical and safe environment. This has been of great importance during the coronavirus disease 2019 global pandemic. This literature review was conducted to suggest a direction for simulation-based nursing education in Korea. METHODS: For literature searches, the authors used the following search terms in the Web of Science, CINAHL, Scopus, PubMed-'utilization', 'simulation,' 'nursing student', 'nursing education'. A final search was conducted on 6 January 2021. The materials for this study were collected through literature searches according to the PRISMA guidelines. RESULTS: 25 papers were selected as the final literature for analysis. The study was conducted for 48 percent of senior students in nursing college students in Korea (N = 12). High fidelity (HF) as the simulation type was 44 percent (N = 11). The simulation education subjects were composed of 52 percent adult health nursing (N = 13). According to educational goals described by Benzamine Bloom (1956), 90% in the psychomotor domain is considered a positive learning achievement. CONCLUSIONS: Effectiveness in the psychomotor domain through simulation-based training is correlated with expert nursing. It is essential to develop a systematic debriefing model and methods to evaluate performance and learning in the short- and long-term to expand the effectiveness of simulation-based education in nursing.

Hacking Intraosseous Infusion Skills Training With 3D Printing: maxSIMIO Drilling System.

Intraosseous (IO) infusion is an alternative way to access the vascular system to administer drugs and fluids, which is particularly helpful when the commonly used peripheral intravenous route is inaccessible. The IO procedure can be done using a drill that involves disinfecting the area, landmarking the insertion point, seating the needle in a firm and stable position in the bone, and then delivering a smooth fluid flush. However, in the current medical training landscape, access to commercially available IO drills such as the Arrow® EZ-IO® Power Driver (EZ-IO; Teleflex, Morrisville, North Carolina, United States) is difficult, especially for rural and remote areas, due to the high costs. Furthermore, the EZ-IO is not rechargeable and does not clearly indicate the remaining battery life, which could potentially put patients at risk during the IO procedure. This technical report aims to address these concerns by describing the development of an alternative, affordable, and reliable IO drilling system for training use: the maxSIMIO Drilling System. This system consists of a cordless and rechargeable IKEA screwdriver which connects to a conventional, hexagon-shaped 3D-printed drill bit needle adapter. Two needle adapters were created: Version A was designed to use a friction-based mechanism to couple the screwdriver with the EZ-IO training needle, while Version B relies on a magnetic mechanism. The major differences between the EZ-IO and the screwdriver are that a) the EZ-IO has only one rotation to advance the cannula while the screwdriver features both directions, b) the EZ-IO is not rechargeable while the screwdriver is, and c) the EZ-IO has a custom needle holder that can fit any EZ-IO training needle size while the screwdriver needs to have a custom needle adapter made to connect to the EZ-IO training needle. Overall, through this exploration, the features of the maxSIMIO Drilling System in comparison to the EZ-IO appear more accessible for IO training. Future considerations for this development include gathering clinical expertise through rigorous testing of this novel system.

Avatar and distance simulation as a learning tool - virtual simulation technology as a facilitator or barrier? A questionnaire-based study on behalf of Netzwerk Kindersimulation e.V.

Background: Virtual simulation modalities have been implemented widely since the onset of the severe acute respiratory syndrome coronavirus 2 pandemic restrictions in March 2020, as educators face persistent restrictions to face-to-face education of medical students and healthcare professionals.There is paucity of published data regarding the benefits and barriers of distance and avatar simulation training modalities. Methods: Following a 2-day virtual pediatric simulation competition facilitated by Netzwerk Kindersimulation e.V., using remote human avatars and distance simulation, we conducted a multicenter survey to explore the advantages and challenges of avatar and distance simulation among participants. We used a modified Delphi approach to draft and develop the 32-item online questionnaire with 7-point Likert-like scales (7 being the highest rating). Results: Twenty participants answered our questionnaire. Respondents indicated both a high overall satisfaction (median of 5.0 [Q25-Q75: 4.0-6.0] ) for avatar and distance simulation 6.0 (5.0-6.0), respectively, as well as a high achieved psychological safety with both simulation types (5.0 [4.0-6.0] vs. 5.0 [4.0-6.0]). The most frequently reported profits of avatar and distance simulation included the elimination of travel distances, associated lower costs, less time spent attending the education activity, and effective communication and leadership training, especially with avatar simulation. Most often named challenges were technical problems, limited reception of non-verbal cues and a spatial distance from the team/educator. Discussion: Based on the results of this pilot study, avatar and distance simulation can be employed successfully and appear to be good supplements to face-to-face simulation. Other studies are warranted to further explore the effectiveness of various types of virtual simulation compared to conventional presential simulation. We suggest using avatar-based simulation for targeted communication and leadership skills training and the application of distance simulation to bring simulation experts virtually to remote places where educator resources are lacking.

A Newly Developed Interprofessional In-Situ Simulation-Based Training for Airway Management of COVID-19 Patients: Identification of Challenges and Safety Gaps, and Assessment of the Participants' Reaction.

Background: Healthcare providers performing aerosol-generating procedures like airway management are at the highest risk for contamination with coronavirus disease 2019 (COVID-19). We developed an in-situ simulation (ISS) airway management training in confirmed or suspected COVID-19 patients for emergency and anesthesiology staff, evaluated participants' reactions, and identified perceived challenges. Methods: We used a cross-sectional study design incorporating a quantitative questionnaire to describe participants' reaction to the ISS and a qualitative group interview using the plus-delta debriefing modality to explore participants' challenges in acquiring the knowledge and skills required for each learning objective. Data were analyzed using descriptive statistics and deductive content analysis. Results: Two hundred and ninety-nine healthcare providers participated in 62 ISS training sessions. Over 90% of our study participants agreed or strongly agreed that: they understood the learning objectives; the training material appropriately challenged them; the course content was relevant, easy to navigate, and essential; the facilitators' knowledge, teaching, and style were appropriate; the simulation facilities were suitable; and they had ample opportunities to practice the learned skills. The main challenges identified were anticipating difficult airways, preparing intubation equipment, minimizing the number of personnel inside the room, adhering to the proper doffing sequence, preparing needed equipment outside the intubation room, speaking up, and ensuring closed-loop communication. Conclusion: The newly developed ISS training was feasible for busy healthcare practitioners to safely perform airway management procedures for suspected or confirmed COVID-19 patients without affecting bedside care. Anticipation of difficult airways and speaking up were the most frequent challenges identified across all specialties in this study.

C-STARS: a collaborative online learning environment for situated translation teaching in higher education

Purpose Before COVID-19 pandemic, translation students in higher education attended courses on computer-assisted translation to acquire operational knowledge of professional software, without experiencing collaborative/interactive learning. In few European universities skills labs were introduced to offer fieldwork-like activities, but without shared modelling standards and mainly held in presence for few consecutive days. As the COVID-19 pandemic further deprived students of crucial educational experiences, the purpose of this paper is to present an online collaborative learning environment exploiting a customised combination of information and learning applications the students already experienced during the pandemic to smoothen their learning curve and increase the educational effectiveness. Design/methodology/approach A multi-framework methodology to build and operate a computer-supported online collaborative skills lab for translation students is proposed. Reference standards and guidelines are leveraged to provide participants with a common knowledge ground, to activate the computer-supported collaborative learning perspective, and to ensure an appropriate simulation fidelity. Findings An end-to-end implementation of the proposed approach along with educational effectiveness analysis performed via complementary assessment strategies is presented. Achieved outcomes highlight significant participation rate, consistent improvement in technical and soft skills at both individual and collective levels, and clear activation of collaborative learning dynamics. Practical implications Every master degree in translation teaching can adopt this approach by complying with the proposed guidelines. Originality/value The proposed multi-framework approach is novel and applied to a teaching sector where it is highly needed to fill a pre-existing gap.

Facilitator reflections on online delivery of simulation-based mental health education during COVID-19

Purpose During COVID-19, Maudsley Simulation successfully pivoted to fully online delivery of simulation-based education (SBE) in mental health. In migrating digitally, the simulation faculty experienced a range of new phenomena and challenges. The authors' experiences may be transferable to other specialities and for other educator groups. By sharing the authors' experiences, this study aims to support others adapt to online SBE. Design/methodology/approach This piece represents the authors' collective reflections on the challenges of adapting their facilitation skills to the online environment. It also offers various suggestions on how to improve the learner experience in view of these challenges. Findings Beyond merely platform orientation and operating procedure familiarisation, the team gained insights into ensuring optimal learning, engagement and participant experience during online deliveries. Delivery of online SBE brings several potential barriers to psychological safety and these warrant careful consideration by experienced simulationists. Practical implications Optimising participant engagement and psychological safety remain key considerations despite this novel medium. Facilitators must be willing to adapt accordingly to begin delivering high-quality online SBE. Originality/value From their experience, facilitators must reframe their debriefing expectations and adjust how they engage participants and manage group dynamics given the inherently different nature of this new learning environment.

Simulation-Based Education Implementation in Pharmacy Curriculum: A Review of the Current Status.

Simulation-based education (SBE) is a fundamental teaching method that complements traditional teaching modalities. SBE has improved students' knowledge, understanding, and numerous essential skills within undergraduate pharmacy education, similar to traditional teaching methods. However, SBE has become crucial for developing students' teamwork, decision-making, and communication skills. Even though the Accreditation Council for Pharmacy Education (ACPE) has acknowledged the benefit of SBE in interprofessional education (IPE) and the introductory pharmacy practice experience (IPPE). This article provides evidence that SBE can be effective beyond that. This narrative review is focused on the literature related to SBE modalities and the assessment methods of student learning outcomes in the undergraduate pharmacy curriculum. The review illustrates that SBE is an effective teaching method that could be utilized within the pharmacy curriculum. The review also could help pharmacy educators decide on the best modality and placement of integrating patient simulation within the pharmacy curriculum. Combining multiple simulation techniques may be the best way to achieve the desired student learning outcomes.

Does Self-Directed Learning with Simulation Improve Critical Thinking and Motivation of Nursing Students? A Pre-Post Intervention Study with the MAES© Methodology

Motivation and critical thinking are fundamental for the development of adequate learning. The purpose of the present study was to assess the motivation for learning and critical thinking among nursing students before and after self-directed simulation-based training using the MAES© methodology. A cross-sectional and descriptive quantitative study was conducted with a sample of third-year nursing students. The instruments utilized were the Spanish-adapted version of the Motivated Strategies for Learning Questionnaire (MSLQ-44), and the Critical Thinking for Nursing Professionals Questionnaire (CuPCPE). The students improved their levels both of motivation components, (such as self-efficacy, strategy use, self-regulation) and critical thinking components (such as personal characteristics, intellectual and cognitive abilities, interpersonal abilities and self-management, and technical abilities). These improvements could be a result of the intrinsic characteristics of the MAES© methodology (as a team-based, self-directed, collaborative and peer-to-peer learning method).

Online Faculty Development: An African Lusophone Ophthalmic Society Experience During the COVID-19 Pandemic.

PURPOSE: Faculty development for procedural specialists aims at developing both their medical education and surgical competence. This has been challenging during the COVID-19 pandemic, especially in under-resourced settings and African Lusophone ophthalmology community has been no exception. The Mozambican College of Ophthalmology (MOC) and the Continuing Professional Development Committee of the International Council of Ophthalmology (ICO) established a collaboration to enhance simulation-based clinical teaching competence in cataract surgery. METHODS: Ten Mozambican ophthalmologists experienced in teaching cataract surgery participated in a group mentoring assisted 6 month/11 flipped-learning online experience on curriculum design, which included practice-based and social learning strategies, continuous bidirectional feedback, individual and group reflection opportunities, and the demonstration of declarative and procedural competencies. Program evaluation consisted of pre and post-test knowledge assessment; individual homework, informed by curated reading and a recorded lesson; feedback surveys for each module and one month after the program's conclusion, and a longitudinal project on creating a simulation-based education session on one step of cataract surgery. RESULTS: Participants a) highlighted the opportunity to advance their scholarly teaching skills as facilitators; b) showed an increase in knowledge post-test, expressed commitment to improve their learning experiences´ design, include interactive educational methods, and provide constructive feedback; and c) formed a sustained community of practice of ophthalmologists educators (CoP). CONCLUSION: This online faculty development program, assisted by group mentoring, held during the COVID-19 pandemic, facilitated the development of a CoP and was effective in enhancing teaching competence in curriculum design to apply in simulation-based learning environments.

MaxSim: a novel simulation-based education course for OMFS emergencies.

For oral and maxillofacial surgery (OMFS) senior house officers (SHOs) with no formal medical training, the first exposure to emergency scenarios will be the first time they have to manage them, usually alone. Simulation-based education (SBE) has been demonstrated to increase experience and confidence when used in medical education, so an OMFS SBE course was created to facilitate this. The course was centred on scenarios that necessitate a rapid response, including sepsis, retrobulbar haemorrhage, and carotid artery blowout. A questionnaire with a 10-point numerical score was given to assess the change in confidence when managing these scenarios. Learner numbers were limited due to the COVID-19 pandemic, but all 10 completed both questionnaires. There was an even distribution between first and second-year SHOs. Two had received simulation training before, but it was very limited. In all stations every learner felt an increase in confidence, on average by 45% (range 38%-56%, p<0.05) on the 10-point scale. Positive feedback was also given by them all. SBE has been shown to be an invaluable method of training for clinical scenarios and needs to become common in OMFS. The course is to be expanded post COVID-19 to become available nationally.

Cross-disciplinary perspectives on the transition to remote education.

The COVID-19 pandemic has prompted the cancellation of clinical attachments and face-to-face teaching at medical schools across the world. Experiential learning-through simulation or direct patient contact-is essential for the development of clinical skills and procedural knowledge. Adapting this type of teaching for remote delivery is a major challenge for undergraduate medical education. It is also an opportunity for innovation in technology enhanced learning and prompts educators to embrace new ways of thinking. In this article, the authors explored how educators from different disciplines (medicine, music and performing arts) are using technology to enhance practical skills-based learning remotely. The authors, five experienced educators from different fields (surgery, medicine, music and magic), jointly documented the transition to technology enhanced remote teaching through a series of five structured conversations. Drawing from literature on distance learning in medicine and professional experience in education, the authors identified seven practice-enhancing recommendations for optimising teaching of procedural knowledge and skills. These are: (1) make a virtue out of necessity; (2) actively manage your environment; (3) make expectations clear; (4) embrace purposeful communication; (5) use digital resources; (6) be prepared for things to go wrong and (7) personalise the approach. The authors argue that widening the discourse in technology enhanced learning to include cross-disciplinary perspectives adds richness and depth to discussions. This article demonstrates a cross-disciplinary approach to addressing challenges in technology-enhanced medical education.

Reinstating a national simulation programme in anaesthesiology during the coronavirus pandemic.

Background: With the introduction of strict public health measures due to the coronavirus pandemic, we have had to change how we deliver simulation training. In order to reinstate the College of Anaesthesiologists Simulation Training (CAST) programme safely, we have had to make significant logistical changes. We discuss the process of reopening a national simulation anaesthesiology programme during a pandemic. Methods: We approached how to reinstate the programme with three distinct but intertwined projects, as in the following: (1) a survey of effects of the pandemic on training opportunities for anaesthesiology trainees, (2) proposals for methods of reinstating simulation were developed under the headings avoidance, compromise, accommodation and collaboration. A small online video-assisted simulation pilot was carried out to test the compromise method, (3) having opted for combined accommodation (onsite with smaller participant numbers and safety measures) and collaboration (with other regional centres), a postreinstatement evaluation during a 4-month period was carried out. Results: (1) Eighty-five per cent of 64 trainees surveyed felt that they had missed out not only just on simulation-based education (43%) but also on other training opportunities, (2) when five trainees were asked to state on a 1 to 5 Likert scale (strongly disagree, disagree, undecided, agree and strongly agree) whether online video-assisted simulation was similar to face-to-face simulation in four categories (realism, immersion, sense of crisis and stress), only 9 (45%) of the 20 answers agreed they were similar, (3) When onsite simulation was reinstated, the majority of trainees felt that training was similar to prepandemic and were happy to continue with this format. Conclusion: In order to reinstate simulation, we have identified that accommodation and collaboration best suited the CAST while compromise failed to rank high among trainees' preferences. Onsite courses will continue to be delivered safely while meeting the high standards our trainees have come to expect.

Digital Simulation Improves, Maintains, and Helps Transfer Health-Care Providers' Neonatal Resuscitation Knowledge.

Purpose: To safely care for their newborn patients, health-care professionals (HCP) must undergo frequent training to improve and maintain neonatal resuscitation knowledge and skills. However, the current approach to neonatal resuscitation simulation training is time and resource-intensive, and often inaccessible. Digital neonatal resuscitation simulation may present a convenient alternative for more frequent training. Method: Fifty neonatal HCPs participated in the study (44 female; 27 nurses, 3 nurse practitioners, 14 respiratory therapists, 6 doctors). This study was conducted at a tertiary perinatal center in Edmonton, Canada from April-August 2019, with 2-month (June-October 2019) and 5-month (September 2019-January 2020) follow-up. Neonatal HCPs were recruited by volunteer sampling to complete a demographic survey, pre-test (baseline knowledge), two digital simulation scenarios (intervention), and post-test (knowledge acquisition). Two months later, participants repeated the post-test (knowledge retention). Five months after the initial intervention, participants completed a post-test using a table-top simulation (knowledge transfer). Longitudinal analyses were used to compare participants' performance over time. Results: Overall the proportion of correct performance increased: 21/50 (42%) passed the pre-test, 39/50 (78%) the post-test, 30/43 (70%) the 2-month post-test, and 32/40 (80%) the 5-month post-test. GLMM and GEE analyses revealed that performance on all post-tests was significantly better than the performance on the pre-test. Therefore, training with the RETAIN digital simulation effectively improves, maintains, and transfers HCPs' neonatal resuscitation knowledge. Conclusions: Digital simulation improved, maintained, and helped transfer HCPs' neonatal resuscitation knowledge over time. Digital simulation presents a promising approach for frequent neonatal resuscitation training, particularly for distance-learning applications.

Exploring student perceptions of virtual simulation versus traditional clinical and manikin-based simulation.

BACKGROUND: The COVID-19 pandemic immediately changed the way nursing programs provide clinical experiences for pre-licensure nursing programs. Healthcare organizations closed access to clinical experiences for nursing students and universities immediately shifted to remote learning and online virtual simulation. PURPOSE: This research examined students' perceptions of virtual simulation in meeting their learning needs when compared to traditional clinical experiences and manikin-based simulation environments. METHODS: A retrospective multi-site exploratory, descriptive design had 97 participants complete the Clinical Learning Environment Comparison Survey 2.0 after having experienced virtual simulation. A Kruskal-Wallis test was used to examine differences among participants when grouped by degree program and level/term within the nursing program. RESULTS: Traditional clinical experiences met students' perceived learning needs for all degree programs of study for subscale items of communication, nursing process, holism, critical thinking, and self-efficacy. When grouped by level/term, traditional clinical experiences met all students' perceived learning needs for every subscale item. Manikin-based simulation met students' perceived learning needs for subscale items of critical thinking and teaching-learning dyad while virtual simulation met perceived learning needs for subscale items of nursing process, critical thinking, self-efficacy, and teaching-learning dyad. CONCLUSION: While traditional clinical learning experiences remains the "gold standard", manikin-based and virtual simulation do meet specific important learning needs.

Meeting pharmacy educational outcomes through effective use of the virtual simulation MyDispense.

INTRODUCTION: One of the challenges of pharmacy schools worldwide is the need to link theoretical training with the mastery of practical skills. A virtual pharmacy simulation, MyDispense, developed by the Faculty of Pharmacy and Pharmaceutical Sciences at Monash University, enables students to practice the skills of a professional pharmacist, from novice to highly advanced, in a safe virtual environment that is web-based and highly accessible. The free online simulation allows students to undertake scenarios where patients can present with prescription or self-care requirements, and are also challenged with validation tasks requiring them to check the work of virtual colleagues for accuracy, legality, and medicine safety. COMMENTARY: This commentary describes the use of a virtual simulation, MyDispense, in enhancing didactic instruction, complementing experiential education, and the challenges of the virtual simulation to pharmacy educators. MyDispense is now deployed to 186 schools of pharmacy across 34 countries to over 25,000 students worldwide who have completed over 963,000 exercises globally. IMPLICATIONS: The severe acute respiratory syndrome 2 (aka COVID-19) pandemic presents challenges to pharmacy education requiring many educators to switch to remote online learning. Simulation programs, such as MyDispense, help to replicate aspects of pharmacy practice and can be used creatively to meet course needs. The use of MyDispense is an excellent example of pharmacy educators collaborating globally and learning from each other to improve student learning.

Use of Virtually Facilitated Simulation to Improve COVID-19 Preparedness in Rural and Remote Canada.

Background: The Alberta Health Services' Provincial Simulation Program (eSIM) is Canada's largest simulation program. The eSIM mobile simulation program specializes in delivering simulation-based education (SBE) to rural and remote communities (RRC). During the COVID-19 pandemic, a quality improvement project involving rapid cycle in situ virtually facilitated simulation (VFS) for COVID-19 airway management and health systems preparedness in RRC was successfully implemented. Methods: Between April 24 and July 31, 2020, a team of six rural simulationists (four nurses and two physicians) provided 24 VFS sessions with virtual debriefing to 200 health care providers distributed across 11 RRC in Alberta and the Northwest Territories, covering a geographic area of approximately 169,028 km2. Results: Video analysis of sequential VFS rapid cycle sessions using a standardized observational tool indicated decreased personal protective equipment (PPE) breaches by 36.6% between the first and third cycles. Teams demonstrated increased competency with airway management such as correct use of bag-valve-mask ventilation, and implementation of health system process improvements, such as incorporation of an intubation checklist. Improvements occurred on average over 2.2 rapid cycles completed within 1.3 weeks per RRC. Postsession self-reported participant electronic surveys indicated self-reported improvement in clinical management, teamwork behavior, and health systems issues outcome measures which were categorized based on the Crisis Resource Management and Systems Engineering Initiative for Patient Safety (SEIPS) frameworks. Of the 48 survey respondents, 86.1% reported that VFS was equivalent or superior to in-person simulation. The cost of VFS was 62.9% lower than comparable in-person SBE. Conclusion: VFS provides a rapidly mobilizable and cost-effective way of delivering high-quality SBE to geographically isolated communities.